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FINAL ACTION 

Response to Amendment 

1 . The following Office Action is responsive to the amendment and remarks 
received on October 3, 2007. Original claims 2, 3, 37, and 38 were canceled and 
claims 1 , 4-36, and 39-70 remain pending. In response to the amendment, the previous 
drawing and specification "objections" are withdrawn. 



Claim Rejections - 35 USC § 102 



2. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 1 02 that 
form the basis for the rejections under this section made in this Office action: 
A person shall be entitled to a patent unless - 

(a) the invention was known or used by others in this country, or patented or described in a printed 
publication in this or a foreign country, before the invention thereof by the applicant for a patent. 

(b) the invention was patented or described in a printed publication In this or a foreign country or in 
public use or on sale in this country, more than one year prior to the date of application for patent in 
the United States. 



(e) the invention was described in (1) an application for patent, published under section 122(b), 
by another filed in the United States before the invention by the applicant for patent or (2) a 
patent granted on an application for patent by another filed in the United States before the 
invention by the applicant for patent, except that an international application filed under the 
treaty defined in section 351(a) shall have the effects for purposes of this subsection of an 
application filed in the United States only if the international application designated the United 
states and was published under Article 21(2) of such treaty in the English language. 



3. Claims 1 , 5-13, 16, 36, 40-48. and 51 are rejected under 35 U.S.C. 102(e) as 
being anticipated by Yeo et al. (US 6.738,509 B2). 
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Regarding claims 1 and 36, Yeo discloses a method for processing images 
("Multi-spectral images can be described in any one of a plurality of known spectral or 
color spaces" at column 1 , line 21 ), the method comprising: 
act A: converting a first image data from a first color space into a second image data 
that corresponds to a second color space (as depicted in figure 9 , numeral 902 to 
perform color space 1 to 2 transform); 

act B: perform image processing on the second image data in the second color space to 
form a processed image data (as depicted in figure 9, numerals 904 and 906 to perform 
data compression process); and 

act C: converting the processed image data to a third image data that corresponds to 
first color spaces (as depicted in figure 9, numeral 908 to perfomi color space 2 to 1 
transfomi); 

the first color space is a single color component color space (as depicted in figure 9, 
color space 1 components (A and B) are input into a color space 1 to color space 2 
transformer 902 where components A and B are part of the multi-spectral image; "[a] 
multi-spectral image is a collection of two or more monochrome images of the same 
scene. Multi-spectral images can be described in any one of a plurality of known 
spectral or color spaces" at column 1 , line 20. The color space 1 components (A and B) 
are monochrome, i.e. single color component. Thus, the first color space can be a 
single color component color space). 
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Regarding claims 5 and 40, the second color space is a single color component 
color space (discussed in claims 1 and 36, the single color component color space is 
disclosed). 

Regarding claims 6-7, and 41-42, the second color space is a multiple color 
component color space ("... color space 2 may be YCbCr color space. Other color 
space combination are also possible ..." at Yeo column 4, line 49). 

Regarding claims 8 and 43, the third color space is a single color component 
color space (discussed In claims 1 and 36, the single color component color space is 
disclosed). 

Regarding claims 9-10, and 44-45, the third color space is a multiple color 
component color space (according to act C the third color space is color space 1 ; "color 
space 1 may be any color space, such as RGB color space, for example" at Yeo column 
4, line 9). 

Regarding claims 1 1 and 46, act A further comprises using one or more 
temporary buffers to store the second image data ("... a system unit having a central 
processing unit (CPU) and associated volatile and non-volatile memory, including all 
RAM ...CD-ROM drive ..." at Yeo column 10, line 42). 
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Regarding claims 12 and 47, act B further comprises using one or more 
temporary buffers to store the processed image data (discussed in claims 1 1 and 46). 

Regarding claims 13 and 48, act B further comprises image data compression 
(as depicted in Yeo figure 9 for data compression process). 

Regarding claims 16 and 51, act A further comprises applying a conversion 
equation to each pixel, wherein the conversion equation is selected based on the 
second color space (as depicted in Yeo figure 4, numeral 402 shows the color space 
conversion equations). 



Claim Rejections - 35 USC § 103 

4. The following is a quotation of 35 U.S.C. 103(a) which fomis the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described 
as set forth in section 102 of this title, if the differences between the subject matter sought to be 
patented and the prior art are such that the subject matter as a whole would have been obvious 
at the time the invention was made to a person having ordinary skill in the art to which said 
subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

5. Claims 4 and 39 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
the combination of Yeo and Acharya et al. (US 6,236,433 B1, hereinafter refenred to as 
Acharya433). 
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Regarding claims 4 and 39, Yeo discloses a single color component color space. 
Yeo does not explicitly disclose the single color space is an RGB raw space. 

Acharya433, in the same field of endeavor of color representation ("relates to 
image scaling and color interpolation/recovery" at column 1 , line 9), discloses: "digital 
still and video cameras and certain other imaging devices, raw images are first 
represented as rectangular row and column of pixels with each pixel having the intensity 
value of a particular color only ..." at column 2, line 18. As depicted in figures 1 and 2 
"in FIG. 1 is applicable specifically to an image in its CFA (Color Filter An-ay) form, as 
derived for instance, from an image sensor or set of image sensors. A common CFA 
pattern is the Bayer pattern (described below and shown in FIG. 2) which has each pixel 
location in the array associated with one of three colors Red (R), Green (G) or Blue (B) 
..." at column 3, line 62, 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to include the color transfomnation system Yeo made with an RGB raw 
color space as taught by Acharya433, such that the color conversion system can handle 
data with the color space from "digital still and video cameras and certain other imaging 
devices" at Acharya433 column 2, line 18. 

6. Claims 14-15, 17-28, 49-50, and 52-63 are rejected under 35 U.S.C. 103(a) as 
being unpatentable over the combination of Yeo and Rashkovskiy et al. (U.S. 6,252,577 
B1). 
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Regarding claims 14, 28, 49, and 63, Yeo discloses color space transfomnation 
from 1 to 2. Yeo does not explicitly disclose the color space interpolation. 

Rashkovskiy, in the same field of endeavor of "digital image processing" at 
column 1 , line 5, discloses the details of interpolation from a single color component to a 
multiple color component: "each pixel in the original image is converted from having a 
single color component into one pixel having multiple color components ... by 
interpolating the additional color components of a pixel based on the intensities and 
colors of its neighboring pixels ..." at column 1, line 37. Thus, the interpolation is based 
on nearest neighbor interpolation. 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to implement the color space transformation methodology of Yeo made, 
with single/multiple color interpolation as taught by Rashkovskiy, in order to explicitly 
describe the steps of color interpolation processing for "efficiently downscaling images 
and for transfem'ng images" at Rashkovskiy column 1 , line 6. 

Regarding claims 15 and 50, applying a conversion equation to each interpolated 
pixel, wherein the conversion equation is selected based on the second color space (as 
depicted in Yeo figure 4, numeral 402 shows the color space conversion equations. 
See also Rashkovskiy column 1, line 44 "a conversion is performed upon the multiple 
component pixels from the color space of the image sensor to a color space that is 
more suitable for mathematical processing"). 
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Regarding claims 17 and 52. color interpolation further comprises deriving 
missing color components for each pixel from the pixel's neighboring pixels, wherein the 
neighboring pixels contain the missing color components ("missing components are 
then determined by applying an interpolation methodology" at Rashkovskiy column 2. 
line 21; "interpolation the additional color components of a pixel based on the intensities 
and colors of its neighboring pixels" at Rashkovskiy column 1 , line 42). 

Regarding claims 18-20 and 53-55, deriving missing color components for each 
pixel from the pixel's neighboring pixels (as described in Rashkovskiy Equation-1 at 
column 5, the products are then summed or averaged to yield a component of the target 
pixel. A 3X7 target area, as shown at column 4. is for illustration purpose, "the operator 
may take on a larger or smaller size. In addition, the an'ay need not have an odd 
number of coefficients on each side ..." at column 5. line 1. The coefficient cg(i, j) in 
Equation-1 is the nonnalized weighting factor shown by Equatlon-2. 

In order to derive missing color components for each pixel from the pixel's closest 
previous and next pixels in a horizontal direction, Equations-1 and 2 can apply to a 1X3 
target area e.g. G(9) B(1 0) G(1 1 ). Thus. G at position 1 0. i.e. G(1 0). can be the 
averaging of closest previous pixel G(9) and next pixel G(1 1 ) in the horizontal direction 
when weighting factor is 0.5. Othenwise, G(10) can be estimated by appropriate 
weighting factors). 
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Regarding claims 21-22 and 56-57, act S further comprises averaging pixels 
corresponding to each missing color component from the previous line of pixels (With 
proper selection of the size of target area, Rashkovskiy Equations-1 and 2 can be used 
to derive averaged or weighted pixel values corresponding to each missing color 
component from the previous line of pixels). 

Regarding claims 23 and 58, the fixed number is based on missing color 
components from previous frames ("... missing components, however, may now be 
readily computed using conventional interpolation techniques as will be apparent to 
those of ordinary skill in the art . .." Rashkovskiy at column 4, line 1 . Thus, the fixed 
number is based on missing color components from previous frames is one acceptable 
alternative method). 

Regarding claims 24 and 59, low-pass filters used ("next step is to determine the 
filtering that will be applied to the selected region to generate the G component of the 
target pixel in the scaled image ... Equation-3 ..." Rashkovskiy at column 6, line 13. 
"Any one of a number of different filters can be used for h(j), but the well known 
Hamming filter works particulariy well ..." Rashkovskiy at column 6, line 64. Where 
Hamming filter is a low pass filter). 

Regarding claims 25-27 and 60-62, using filters before, after, before and after 
perfonning the color interpolation (as discussed in claims 24 and 59, performing filter 
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after interpolation. However, Equations-4 and 5 of Rashl<ovsl<iy at column 6, perfomi 
ttie filter before interpolation. Without departing from the essence of Rashkovsl^iy's 
methodologies, filters can be applied before and after perfonning the color 
interpolation). 

7. Claims 29-32 and 64-67 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Yeo and Acharya (US 2002/0101524 A1, 
hereinafter referred to as Acharya002). 

Regarding claims 29 and 64, Yeo discloses color space transformation from 2 to 
1 . Yeo does not explicitly disclose the details of color space re-mapping process. 

Acharya002, in the same field of endeavor of image processing ("the invention . 
relates to the field of digital imaging systems and software" in paragraph 4, line 2), 
discloses a known technique to process 8-bit Bayer data to 24-bit RGB then to 24-bit 
YCrCb and re-map to 12-bit YCrCb as depicted in figure 1, also his invention of single 
pass from 8-bit Bayer data to 12-blt YCrCb in figure 4. 

It would have been obvious at the fime the invention was made to one of ordinary 
skill in the art to provide the color space transformation methodology Yeo made with the 
mapping technique as taught by Acharya002, in order not only to explicitly illustrate the 
color transfonn processing but also to "image memory size can all be reduced" in 
Acharya002 paragraph 14, line 11. 
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Regarding claims 30 and 65, act C further comprises applying a conversion 
equation to each pixel of the processed image data, wherein the conversion equation is 
selected based on a selected color space from the set of color spaces (as depicted in 
Yeo figure 5, numeral 502 shows the color space conversion equations). 

Regarding claims 31 and 66, after applying the conversion equation, re-mapping 
each pixel of the processed image data into the selected color space (as discussed in 
claims 30 and 65 conversion equation applies to each pixel; claims 29 and 64 to re-map 
each pixel of the processed image data into the selected color space). 

Regarding claims 32 and 67, re-mapping includes dropping undesired color 
components (as depicted in Acharya002 figure 1C and figure 4, the undesired color 
components of Cb and Cr are dropped so the file size can be reduced). 

8. Claims 33-35 and 68-70 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over the combination of Yeo and Acharya002 as applied to claims 29-32 
and 64-67 discussed above and further in view of Rashkovskiy et al. 

The Yeo and Acharya002 combination teaches color conversion and re-map. 
The Yeo and Acharya002 combination does not explicitly teach the details of filtering 
process. 

Rashkovskiy, in the same field of endeavor of "digital image processing" at 
column 1 , line 5, also teaches "the well known Hamming filter works particulariy well 
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and is relatively simple to Implement" at column 6, line 66. As discussed in claims 25- 
27 and 60-62 this filter can be applied before, after, and before and after color 
interpolation. Without departing from the scope and spirit of Rashkovskly's 
methodologies, this filter can also be applied before, after, and before and after 
dropping undesired color components. 

It would have been obvious at the time the invention was made to one of ordinary 
skill in the art to enable the color space transformation system of the Yeo and 
Acharya002 combination, with filtering technique as taught by Rashkovskiy, in order not 
only to explicitly illustrate the color transform processing but also to avoid "any aliasing 
effects" at Rashkovskiy column 7, line 31. 



Response to Arguments 

9. Summary of Applicant's Remark: 

The previous drawing and specification objections should be withdrawn in view of the 
amendment. 
Examiner's Response : 

Examiner agrees, and the previous objections are withdrawn. 

10. Summary of Applicant's Remarlis: 

"Yeo recites an example of a multi-spectral image (i.e., an RGB color image) as 
consisting of three components (i.e., red, green, and blue). Nowhere, in the cited portion, or 
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elsewhere in Yeo, does Yeo disclose a first color space as a single color component color 
space, as expressly recited by Applicants" at response page 26, line 1. 
Examiner's Response : 

Applicants argument is moot in view of the fact that the component of the input from a 
multi-spectral image is monochrome (i.e. single) color. Thus, in the color space a single color 
component is used. Refer to the rejections above. 

Conclusion 

1 1 . Applicant's amendment is rejected in this Office action. Accordingly, THIS ACTION IS 
MADE FINAL. See MPEP § 706.07(a). Applicant is reminded of the extension of time policy 
as set forth in 37 CFR 1.136(a).- 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1 .1 36(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 

12. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure: 
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• Lu et al. (US 5,805.21 7): Figures 2, 3, and 4for RGB single color component 
color spaces. 

1 3. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Eueng-nan Yeh whose telephone number is 571-270- 
1586. The examiner can normally be reached on Monday-Friday 8AM-4:30PM EDT. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Vikkram Bali can be reached on 571-272-7415. The fax phone number for 
the organization where this application or proceeding is assigned is 571-273-8300. 

Infonmation regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status infomnation for unpublished applications is available through Private PAIR only. 
For more infonnation about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). If you would like assistance from a 
USPTO Customer Service Representative or access to the automated information 
system, call 800-786-9199 (IN USA OR CANADA) or 571-272-1000. 




Eueng-nan Yeh 
Assistant Patent Examiner 
2624 
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